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PREFACE 



In addition to the Examination Procedure , v/hich is 
Illy project for the Incentive Increment, I am submitting 
iny Questionnaire on Foreign Language Testing and Results 
0^“ Questionnaire on Foreign Lan^uct^t^ Testlrx^ . 

(The purpose of the Questionnaire. « . is to make a survey 
of current practices among Foreign Language Specialists. It 
evolved from discussions in the Foreign Language Workshops 
at Beverly Hills High School in which I participated in 1963 
and 1964 . Since opinions varied considerably on many points 
concerning methods of evaluating language skills, I felt 
that a survey of current thinking on the very items we dis- 
cussed might prove valuable in helping to guide us in the 
type and content of our examinations. The present study is 
a secondary project, undertaken only as a survey and too 
limited for conclusions concerning what should or should not 
b-^ done. It would be most interesting, however, to make it 
the subject of a major study at some later date when there 
is as opportunity to prepare a large number of questionnaires 
for widespread distribution. Since only 200 questionnaires 
were prepared, they were carefully circulated through the 
help of personal contacts among key people in almost every 
. *ase of foreign language instruction: supervisors, testing 

experts and specialists in foreign language teaching at the 
the elementary, junior high, high school, junior college, 
college and university levels in representative sections of 
the United States as well as in France. Included are two 
l\lDEA Foreign Language Institutes, one for FLES teachers, the 
Dther for secondary school teachers and supervisors (.held in 
France) . 
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All areas mentioned above are represented among the responses 
received and in the results thereof. An equal number of responses 
were received from eastern and mid-western states (10 each). There 
were 17 responses from western states j not including IS from the 
Beverly Hills Unified School District, Beverly Hills, California. 

At least 10 additional responses from various areas arrived too late 
for tabulation. (Others are expected but, obviously, will not be 
tabulated .) 

I should like to thank Miss Elaine Ominsky of the Baltimore Polytechnic 
Institute for her efforts in circulating the Questionnaire in France; 

Mrs. Hannah Choldin, Foreign Language Consultant for the Chicago High 
Schools, who undertook its distribution among master teachers in the 
Chicago area; Mr. Albert JeKenta, Director of FLES at the Beverly Hills 
Unified School District and Dr. Richard Bertain, Director of Personnel, 
Beverly Hills Unified School District, for their generous cooperation 
and assistance. 



3ii; •''• 1 1: of Questionnaire on 7orei<7;n Testing 



In 3pit^ of the careful tabulation of resj,‘0nccs, i.any 
'ioorepancif s ox-'i'ear to exist in the totals* This is due 
Kiainly to the fact that manj^ questions were not ansv/ered in 
the nanner requested. Also, answers which v/ere to he rated 
in order of preference were very often either omnitted entire- 
ly or i2:coinT>lete5 In some, comments were substituted for 
answers that should have been che'^kedr 



The comments v;ere most difficult to tabulate. It became 
necessary to make a list of all comments given on the section 
in question. Comments that were mentioned most often served 
as the basis for my surumaries. In some cases, minority 
comments were mentioned in the report as a matter of interest o 
Great care was taken to refrain from injecting my personal 
opinions. 

The Questionnaire itself does not treat all phases of 
testing. As mentioned in the Preface, it deals mainly with 
points on which there was some difference of opinion during 
our Workshop discussions. Items on which we agreed did not 
necessarily appear in the Questionnaire. Tnis accounts for . 
the fact that one of the omissions was the matter of manner 
in which directions to the student should be given. I regret 
that this omission was made, since it is an important point. 

It was called to my attention by one of the respondents who 
felt that directions should be given in English. If the 
Questionnaire is circulated again at some future date, I 
shall be certain to include it as v/ell as any other omissions 
that may be call'ed to my attention. 



Vo^abulory and Conorehenaion; Vrltten 
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1. G. 10 

bo 12 

c. 17 

d. 14 

e= 16 



Although a slight preference is~lihown for l.o, tho 
comment thot "each is useful in its proper place was 
^iven in the majority of cases* For example, it v.'as 
mentioned that loa is appropriate in a translation 
course; l.b and l*d in an audio— lingual program; l.c 
v/as considered hardest to control. 



2* ihe concensus wan that the knowledge of an individual 
word cannot be tested without also testing comprehension 
(of other words involved) or intelligence unless a direct 
translation of the word is requested, as in l.a. 

Alternate methods advocated, however, included questions 
requiring synonyms, antonyms, completion and matching 
exercises (in the foreign language) with the full real- 
ization that intelligence and comprehension of words 
other than those being tested entered into these types 
of questions. 
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(Jrammar 



1 • a • 
b. 
c • 

d. 

e. 
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3 
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12 


8 


8 


13 


5 


3 


10 


14 


13 


3 


22 


12 


9 


2 


1 


9 


8 


5 


8 


13 


8 


4 


9 


4 


19 



2. a. 31 

b. 21 

c. 6 



It was generally agreed that questions should test 
one point at a time, especially at the early stages of 
language learning, as evidenced by the fact that l.c 
was clearly chosen as first choice and l.e clearly 



chosen as last choice* 



T^Vn- .C! ■Pooln'nc^ no d-rr-i 



by the overwhelming majority for 2. a. It is interesting 
to note that the example mentioned in 2. a makes an even 
finer distinction inasmuch as it does not test the passe' 
compost but only a part of it, the past participle. 
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General 



b.l. 26 
b.2. 18 

b.3c 11 



The inajority felt that objective examinations ao 
test points adequately provided they test one point 
at a time and, according to the comments, provided 
they are well constructed and geared to the material 
covered in the course. It was also mentioned that 
objective tests should be so constructed as to dis- 
criminate adequately between good students and poor 
ones. Questions should be neither too obvious nor 
too chalengingo 



2. a. 24 
b. 24 
Co 24 

It would seem from the tabulation and from the 
comments that all the conditions presented in this 
question serve as basis for a completely objective 
final examination. (Complete despair was the reaction 
of several people to 2.bl) 
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Audio -Lingual Testing 
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lo 
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b. 
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14 


11 


6 
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c. 


3 


7 


3 


6 


10 


9 


ds 
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4 


12 


4 


5 


12- 


e. 


27 


9 


3 


1 


4 


3 


f. 


15 


14 


3 


5 


5 


6 



The tabulation results (l.e first ohoice; l.f 
second choice; l.h third choice) seem to indicate 
that the most popular type question involved listen- 
ing to a question and giving a spoken response (l.e)o 
The second choice involved listening to a question 
and choosing the correct spoken response (l.f)* 

The third in popularity was a dictee avoiding 
grammatical points as much as possible (l.b). Least 
popular were a dicte'e on completely new material 
(l.c) and wr-t'^.en test on sound discrimination (l.d). 

Although l.e was preferred, concern was express- 
ed in comments as to its feasibility. It was felt 
that while l,e'is difficult" to evaluate objectively, 
l.f' was more practical from this standpoint. It was 
pointed out,, however, that l.f could be extremely 
complex unless items were grouped by types v/ith 
separate directions for each. The dict/e was . 
considered appropriate only as a means of teaching 
orthography. 

2. The comments concerning implementation of i.e revealed 
that a better method is needed. Several people 
suggested that a v/ay of implementing l.e would be to 
give teachers released time to listen to tapes or to 



pace 6 



conduct personal interviews with students (two 
instructors per student, one conducting the inter— 
vicv/, the other taking notes and grading) o Host 
felt that it was not practical and that it required 
more time than was available. 




Department Examination 



JC I 



b. 18 

c. 20 

d. 10 

There was not a clear majority concerning whether 
only the required two-hour final examination should be 
a departmental examination (lob) or whether a mid- 
semester departmental audio-lingual examination should 
also be given (l.c)* There was, however, a clear 
preference for l.b and l.c over l.a and l.d (both 
representing extreme cases - none at all in the 
case of l.a and all unit tests in the case of l.d)® 



2e Comments on whether or not the type of examination 
given is of importance if students are being graded 
on a curve vvere fairly evenly distributed between 
”y6s” and *'no” type answers. Most answers were 
qualified so that a **yes” response became a ”no'* 
response and vice-versa. There was a tendency to 
philosophize on the value of grading on the curve 
even though this was not the question. Sample 
responses are: It must be appropriate ih difficulty 

to avoid discouragement; It does not matter what 
type of examination is given provided there is some 
basis for students to display their relative know- 
ledge of the suoject; It does not matter provided 
each teacher has his own curve; The use of curves 
in grading is of questionable value - a curve may 
serve as a means of hiding poor teaching or a bad 
curriculum; I*m opposed to grading on the curve; 
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J^’or the sake of objectivity, questions must be 
given v/hich have only one ansv/er when graded on the 
curve; V/hy are curves necessary? 

‘ 12 3 

2, a. 45 Z 3 

bo 10 21 22 

c. 1 11 42 

Concerning method of preparation and/or 
selection of an examination, the tabulation 
indicates an overwhelming preference for an 
examination carefully prepared by all members of 
the department and covering all points of the 
textbook (2. a). It is interesting to note that 
the tabulation also reveals an equally over- 
whelming vote opposing an examination prepared 
by a member of the department who is not teach- 
ing that level (2«c)» A commercially prepared 
examination which none of the teachers sees until 
the day it is given (2.b) is only half as objection- 
able as the latter(2.c)o 

3. a. 1 

b. 30 

c. 7 

d. 23 

Most responses showed a preference for telling 
the students the type of examination they will take 
(3*b) with a close second preference for giving as 
much information as possible about the examination 
as long as the actual questions are not revealedi3«d) « 

r* *• 



er|c 



Definite objection is indicated to the two* extreme 
choices, 3 -a, giving no information and 3»c, tell- 
ing students the specific points covered, the latter 
extreme being less objectionable than the former. 

Comments reflected opinions concerning the 
purpose of testing. In several responses in which 
3»b was selected, comments indicated that with 3»d 
a major purpose for giving the examination - moti- 
vation for a review in depth - v/ould be served. 

Other comments were: Students should be responsible 

for whatever is taught since language is cumulative; 
Students should know what type of questions are to 
be asked lor psychological reasons; It depends on 
7/hat is being tested. 



4# a. 16 

b. 25 

c. 11 

A clear majority favored a division of 40^ AL; 
30;^ grammar; 305^ reading. Comments reflected the 
general feeling that distinctions of this type are 
likely to be arbitrary and inflexibility would be 
self-defeating. Since the examination should re- 
flect the organization of the course, the weight 
of each section should be determined by the teacher 
and should depend on the course of study© 
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QUESTIONNAIRE 

This questionnaire Is being circulated throughout the United States 
as well as abroad so that we may collect as much data from as many different 
situations as possible. The information gathered will be used to help us 
in our current revision of testing procedures and policies. In composing 
this questionnaire^ we had in mind primarily trying to arrive at policies 
concerning the preparation of a final examination for students with a FLES 
background who are completing their first year of High School French (French I). 
Your answers will be kept completely confidential and under no circumstances 
will individuals or districts be quoted. Your help and cooperation will be 
greatly appreciated^ and we shall be glad to send you the results of our 
study as soon as they are tabulated. 



Vocabulary and Comprehension? V/ritten 



1 . 



I'ihich of the following questions do you feel really tests the student's 
knowledge of the meaning of individual words? 



a. Give the French word for ”dog” 

b« Q,uel est le contraire du mot ”long"? .. 
c. Je vois avec 

- d. Je vois avec 1) les yeux 2) la bouche 

3) Ic bras 

- o. A few of all four types except 

Other Comments: 



Student's Answer 
le chicn 
court 
les yeux 
i} 2 ^ 3 . 



2. V/ithout using pictures or English^ how can we test the student's 
knowledge of an individual word without also testing comprehension 
or intelligence? (As in samples l.b and l.c) 



Grammar 

1. V/hich of the following groups of questions on the passd con^os^ do you 
feel is the fairest? (Rate them by numbering 1 - 5/* 






Compldtalcs phrases suivantes en employont le passd compost 
des verbes entre parenthbseSw 



1) (Acheter) Void la maison 

quo nous 

2) (Sortir) Je connais la 

fille qui 



Stu dent's answer 
avons achet^e 



• • • • • a • 



est sortie 



b* Compldtcz Ics phrases suWantos on employant la forme 
convcnabic oes voruos entro pa ren theses* 

Student* s answer 



1) (Acheter) Void la maison que nous avons •••• achetde 

2) (Sortir) Jc connals la fllle qui cst sortie 



c. Compldtez les phrases sulvantes en employant Ic pass<^ 
conposd dcs verbes entre parentheses* 



1) (Acheter) Mous la maison avons 

achct (5 

2) (Sortir) Le garjon cst sort I 



d* Compietcz les phrases suivantes cn ^crivant le participe 



passd des verbes entre parentheses* 

1) (Lire) llous avons Ic llvre lu 

2) (iJourir) II cst mort 



c* Compldtcz la phrase suivantc en employant le temps 
convenable dcs verbes entre parentheses* 



1) (Acheter) II n*y cn avalt que trois quand avons ) 

nous les achetds) 

2) (Sortir) Le profcsscur dlait cn train 

d*exp liquor la le^on quand la 

jcune fllle cst sortie 



2 * Do you feel that questions should 

a* Test only one point at a time (as in l*d) 

b* Test several points at a time (as in l*a, l*b, l*c) 

c* Test as much as possible (as in l*c) 

Other Comments: 



General 



1 * V/hat arc your feelings about purely objective tests (The answer Is all 
right, or all wrong*) For example: Choisissez la rdponse convcnabic ct 
indiquez votre rdponsc sur la feuille do rdponse: 



A* Jc n*ai pas vu oiscau bleu 

1 ) cot 

2) 'cos 

3) cette 

k ) ce 



e 
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Student* s answe r 

.JOj . 2 )#' 3 )> 



Student's ansvmr 



S. VoiU ] cs I cunos f n ] e.<; mm 

^ ^ mm 4m 

1) i.'ous avons vuos 

2) sent vonucs 

3) vous avez admlrd 
^0 n a regarddes 



il, 2), 3), k). 



a* They arc completely useless, 
b. They test points adequately^ provided 

. - . - - 1) they test one point at a time, as in A. 

■ - . - 2) they offer more of a challenge^ as in C. 
3) Other 



2. Assuming that an examination in which answers arc written offers. a better 
moans of evaluation^ and assuming that written examinations arc given all 
semester^ chock the condition or conditions which would cause you to 
endorse a completely objective final examination: 

- a* There arc many teachers in the department giving the same 
examination and uniform grading is essential in determining 
departmental curve for this examination. 

Comments: 



b. Final examinations last two hours and each teacher may have two 
classes taking the exam the day before grades and department 
curve are due. 

Comments: _____ 



c. Audio-lingual sections of the examination are given at least a 
week prior to final exam week. 

Comments: ________ 



Audto-LInqual Tostinq 

Please number the following methods of evaluating audio-lingual (and/or 
oral -aural) proficiency in order of preference# 

■ ■ ■ a. Dict^e involving many grammatical points# 

For example: lElles se sent prdsontdes au bureau des Strangers 

e.i: iis Ics ont vues# 

Comments: 



b# Dict6e avoiding grammatical points as much as possible# 
Comments: 



c. Dictdc on compjletcly new material # * 
Comments: 



d# V/ritten test on sound discrimination 

Ex# A# IndiqiLioz si Ics lettres soulign<^es^ droitc so prononcent 
comme les lettres souligndcs i gauche 
!• Q.ILI* cst-ce 1, cat ssc 

2* -Uin - .nom 2# un homme 

C»# lndiqi.iez la prononciation des lettres souitgndes 
en choisissant la reponse convenablo 
1# Lcj§; actual itds a# s b# z c# nc sc 

prononce pas 

o. Have the student ansv/or questions orally (In the lab.) Grade 
as follows: 

1. student cinswers accurately 

2. student pronounces well 

3. student uses correct sentence structure 

k, student urtderstood question thoroughly 

Grad e 

1, 2, 31;. A. 

b: 1^ 2,f or 2^ 3^ or 1^ 2^ 3« 

C: 1>*3' or 2^ ^■^# 

D: student can be understood but docs not receive a 

check for any of tlic A criteria listed above. 

Ft’ there is no response, or ho cannot be understood. 



Ccfnments: 



f* The student hears a sentence followed by three answers, which 

may be rejoinders, explanations, etc. He chooses a, b, or c, 
without seeing any Frencho 



Example: 1) La jeunc fillc est sortie. Elio 

a d 1 1* V • 

The student answers: a), . K), c). 



a) Bonjour 

b) b domain 

c) CG soir-Ui 



Comments: 



Other Suggestions: 



2. How can 1.d< above be implemented in viev/ of the fact that most High School 
Language Labs arc not equipped for recording of student responses? If the 
laboratory is equipped for recording, there is the problem of storing tapes 
or discs until time and place is found to listen to them. (Evaluation of 
students' responses while they are in the lab means that each student is 
being evaluated on a different question.) 

Comments: 



3* Taking Into consideration the problems of administering the test (e.g. 
volume of discs, lack of time, scheduling of classes in the lab on the day 
of the examination) what would you do for the audio-lingual part of your 
final examination? 

■— - a. Hot include any audio-lingual section on the final. Oral grades 
given throughout the semester arc sufficient. 

, . b. Choose a type that can be scored easily (as l.f) and include it 
as part of the two hour exam. 

c. Give a commercially prepared audio-lingual examination which is 
sent out of the district to be scored so as to ensure uniformity. 
It would be scheduled several weeks before the 2 hour final. 

. -■■■ d* Give a commercially prepared audio-lingual examination as a mid- 
semester departmental test, and a 2 hour final without oral 
quest ivons of any type. 

c. Give a locally prepared audio-lingual examination as a mid- 
semester departmental test and a 2 hour final without oral 
questions of any typo. 

f. Give either 3*d or 3*c in combination with 3*b. 




- 5 - 



PepsrtmGnt Exam inat tors 

1. How many department examinations do you feel should be given if the 
school requires a tvA) hour final? 



a^ Hone. 

b# Only the required final examination should be a departmental 
exam. 

c. Two. A mid- semes ter audio-lingual examination and the regularly 
scheduled two hour examination. 

d. All unit examinations (e.g. - five chapter tests given every 
few weeks.) 



2, If students are being graded on a curve^ does it matter very much what 
type of examination is given? 

Comments: ______ 



Please rate the follov/ing in order of preference: 

- a. An examination carefully prepared by all members of the 
department, and covering all points of the textbook. 

■ h. A commercially prepared examination which none of the teachers 
see until the day i’: is given. 

- c. An examination prepared by a member of the department who is 
not teaching that level. 

3. Vihat type of review would students receive as preparation for the test? 

a. Ho information at all should be given beforehand. 

- - h. The students should be told the type of examination they will take. 
c. The students should be told the specific points that will be 

covered on the examination. 

— - d. The students should be given as much information as possible 

about the examination as long as the actual questions arc not 
revealed. 



Comments: 



4. V/hat percentage should be allotted to each section of the exam? 

- , a. 50% audio- 1 ingual (and/or oral -aural); 50% written (including 

grammar, vocabulary, reading comprehension.) 

b. 40% audio-lingual (and/or oral-aural); 30% grammar; 30% reading 

comprehension and vocabulary. 
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